Word Sense Inventories by Non-Experts
نویسندگان
چکیده
In this paper, we explore different strategies for implementing a crowdsourcing methodology for a single-step construction of an empirically-derived sense inventory and the corresponding sense-annotated corpus. We report on the crowdsourcing experiments using implementation strategies with different HIT costs, worker qualification testing, and locale restrictions. We describe multiple adjustments required to ensure successful HIT completion, given significant changes within the crowdsourcing community over the past
منابع مشابه
Multiple Sense Inventories and Test-bed Corpora
Comparing performances of word sense disambiguation systems is a very difficult evaluation task when different sense inventories are used and, even more difficult when the sense distinctions are not of the same granularity. The paper substantiates this statement by briefly presenting a system for word sense disambiguation (WSD) based on parallel corpora. The method relies on word alignment, wor...
متن کاملEvaluating the Word Sense Disambiguation Accuracy with Three Different Sense Inventories
Comparing performances of word sense disambiguation systems is a very difficult evaluation task when different sense inventories are used and, even more difficult when the sense distinctions are not of the same granularity. The paper substantiates this statement by briefly presenting a system for word sense disambiguation (WSD) based on parallel corpora. The method relies on word alignment, wor...
متن کاملWord Sense Disambiguation: A Case Study on the Granularity of Sense Distinctions
The paper presents a method for word sense disambiguation (WSD) based on parallel corpora. The method exploits recent advances in word alignment and word clustering based on automatic extraction of translation equivalents and is supported by a lexical ontology made of aligned wordnets for the languages in the corpora. The wordnets are aligned to the Princeton Wordnet, according to the principle...
متن کاملA Perspective On Word Sense Disambiguation Methods And Their Evaluation
In this position paper, we make several observations about the state of the art in automatic word sense disambiguation. Motivated by these observations, we offer several specific proposals to the community regarding improved evaluation criteria, common training and testing resources, and the definition of sense inventories.
متن کاملTowards a Computational Model of Gradience in Word Sense
In the construction of lexicons or word sense inventories, researchers have usually strived to de ne a set of disjoint senses for a word; however, there is increasing evidence that this is impossible in the general case. In this programmatic paper, we support this point with sense overlap data from manual sense annotation. We then sketch the road towards a fundamentally graded representation of...
متن کامل